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Abstract. 

In this paper we consider a Lagrange Multiplier-type test (LM) to detect 
change in the mean of time series with heteroskedasticity of unknown form. 
We derive the limiting distribution under the null, and prove the consistency 
of the test against the alternative of either an abrupt or smooth changes in 
the mean. We perform also some Monte Carlo simulations to analyze the 
size distortion and the power of the proposed test. We conclude that for 
moderate sample size, the test has a good performance. We finally carry out 
an empirical application using the daily closing level of the S&P 500 stock 
index, in order to illustrate the usefulness of the proposed test. 
AMS classifications codes: 62G10, 62G20, 60F17, 62M10 
Keywords. Brownian bridge, changes in mean, functional central limit 
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1 Introduction 

In the statistic literature there is a vast amount of works on detecting changes 
in mean of a given time series. In a more general context of linear regres- 
sion model, Chow (1960) considered tests for structural change for a known 
single break date. The researches headed for the modelling where this break 
date is treated as an unknown variable. Quandt (1960) extends the Chow 
test and proposes taking the largest Chow statistic over all possible break 
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dates. In the same context, the most important contributions are those of An- 
drews (1993) and Andrews and Ploberger (1994). Sen and Srivastava (1975a, 
1975b), Hawkins (1977), Worsley (1979), Srivastava and Worsley (1986) and 
James et al. (1987) consider tests for mean shifts of normal sequence of vari- 
ables. The multiple structural changes case receives an increasing attention. 
For instance, Yao (1988), Yin (1988) and Yao and Au (1989) study the esti- 
mation of the number of mean shifts of variables sequence using the Bayesian 
information criterion. Liu et al. (1997) consider multiple changes in a linear 
model estimated by least squares and estimate the number of changes using 
a modified Schwarz' criterion. Bai and Perron (1998) consider the estimation 
of multiple structural shifts in a linear model estimated by least squares; Qu 
and Perron (2007) extend Bai and Perron's (1998) results to a multivariate 
regression. In all these papers, a Wald, Lagrange Multiplier (LM) or/and 
Likelihood-ratio (LR)-Like tests have been considered. Recall that the Wald 
test is based on the unrestricted model, the LR test needs the restricted and 
unrestricted model, while the LM test is based exclusively on the restricted 
model. 

Concerning only the change in mean, all authors cited above assume that 
under the alternative hypothesis, the mean fi t is a step function i.e. the 
observations (y t ), 1 < t < n, satisfy 

y t = nt+ e t , 

fit = lit — rij-i + l,...,rij,nj = [\jri\,0 < Ai < ... < A m < 1, 

where (et) is such that E(e t ) = and [x] is the integer part of x. If the mean 
fit is time varying with unknown form, then the Wald and LR tests can't be 
applied. Only the LM test can be used since no specification of alternative 
hypothesis is needed to build a statistic. Recently, Gombay (2008) used an 
LM-type test for detecting change in the autoregressive model. However, he 
assumed that the errors et are homoskedastic i.e var(^) = a 2 for all t. In 
this paper we consider the heteroskedastic time series, 



where the errors are Gaussian white noise et ~ N(0, 1), (a t ) is a deterministic 
sequence with unknown form. The null and the alternative hypotheses are 
as follows: 



under the alternative hypothesis the mean fi t can be time varying with un- 
known form. The model ([!]) is useful in many areas. In financial modelling, 



y t = Ht + cr t e u 



(1) 




Hi : There exist t ^ s such that fi t ^ fi s 



(2) 
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much research has been devoted to the study of long-run behavior of returns 
of speculative asset. A common finding in much of the empirical literature 
is that the returns are not serially correlated which is in agreement with the 
efficient market hypotheses, see Ding et al. (1993). However, the absolute 
returns which, is a proxy of the instantaneous standard deviation, has sig- 
nificant positive autocorrelations with a possible breaks in the mean and in 
the unconditional variance. For instance, Starica and Granger (2005) show 
that an appropriate model to describe the dynamic of the logarithm of the 
absolute returns of the S&P 500 index is given by ([I]) where fi t and a t are 
step functions i.e. 



[it = if t = rij_ x + 1, ...,nj,nj = [\jn],0 < X 1 < ... < X mi < 1, (3) 
a t = er(j) if t = tj-i + 1, ...,tj, tj = [tju], < Ti < ... < r m2 < 1, (4) 

for some integers ni\ and m-i. They also show that model (pQ), ([3]) and (jl]) 
gives forecasts superior to those based on a stationary GARCH(1,1) model. 

One can also consider a more general model than (pQ), ([3]) and (j3J), where 
breaks can be abrupt and/or smooth. A model with (m + 1) regimes for the 
unconditional standard deviation can be defined by 

« = t (l - * {^^) ) + ^ * (^fti) , (5) 

where r = < T\ < ... < r 2m < T 2m +i — 1, Fj is the transition function from 
regime j to regime (j + 1), assumed to be continuous from R onto [0, 1]. The 
scale Sj > indicates how rapidly the transition from regime j to regime 
(j + 1), a small Sj yields an abrupt change, 

As in Gombay (2008) we use an LM-type test for detecting change in 
mean. The test statistic is based on the normalized score vector evaluated 
under the null H' Q : \i t = \x and o t = a for all t > 1. If y t = \i + oe t then the 
log-likelihood of the sample is given by 

n 

L(n,fi,(T ) = --logo- - -log27r -—^(yt-fi) . 

t=i 

Hence, the score vector is 

c (lJ _ ( jsYZJjk-y) \ 



3 



and the information matrix is I n (fi,o~ 2 ) = nl/a 2 , I is the identity matrix. 
Therefore a test statistic for testing change in mean is based on the first 
component of the vector I n ^ 2 (/i, a 2 )S[ nT ](Jl, a 2 ), where /x = *YTt=\Vtl n an d 
o 2 = Y^t=i{Ut ~ V) 2 l n are t ne maximum likelihood estimators of \i and a 2 , 
given by 

[nr] 

v t=l 

The test statistic we consider is 

B n = sup \B n (r) \ . 

re[0,l] 



2 Limiting distribution of B n under the null 

Theorem 1. Assume that (y t ) satisfies the model (QP with standard Gaussian 
white noise errors (e t ) and a bounded deterministic sequence (a t ) satisfying 

1 " 

— a t 2 — t- a\ as n —¥ oo, (6) 

Then, under Ho we have 

B n , B 00 = sup \B(t)\ (7) 

re[o,i] 

C ^ denotes the convergence in distribution and B(t) is a Brownian Bridge. 
Remark. The condition ([H]) is a classical ergodic assumption and holds 
in many situations. For example if (at) is given by 01]), then ()6]) is satisfied 
with o\ = YI^li 1 ^ ~ T 3-i)°%y r o = 0; T m 2 + i = 1, and if (a t ) is given by 
© then 




The proof of Theorem 1 is given in the Appendix. 



3 Consistency of B n 

3.1 Consistency of B n against abrupt changes 

Without loss of generality we assume that under the alternative hypothesis 
there is a single break date, i.e. (y t ) is given by (pQ) where 
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IH= ( ^ li f }-f ~} n ?\ . for some n e (0,1). (8) 
pt \ /i {2) if [nn] +l<t<n iv>; v; 

Theorem 2. Assume that (y t ) satisfies the model (QP u>rf/i standard 
Gaussian white noise errors (e t ) and a bounded deterministic sequence (a t ) 
satisfying If under Hi the mean \i t follows the dynamic (EP then 

B n P > +oo (9) 

where P ) denotes the convergence in probability. 
The proof of Theorem 2 is given in the Appendix. 

Remark 1 . The result of Theorem 2 remains valid if under the alterna- 
tive hypothesis there are multiples breaks in the mean. 



3.2 Consistency of B n against smooth changes 



In economics and finance, multiple regimes modelling becomes more and 
more important in order to take into account phenomena characterized, for 
instance, by recession or expansion periods, or high or low volatility peri- 
ods. Consequently, it's more realistic to assume that the break in the mean 
doesn't happen suddenly but the transition from one regime to another is 
continuous with slowly variation. A well known dynamic is the smooth tran- 
sition autoregressive (STAR) specification, see Terasvirta [22], in which the 
mean fi t is a time varying with respect to the following 

= /J-(i) + (/4(2) - fi(i))F(t/n,Tx,i), l<t<n, (10) 

where F(x, 71,7) is a the smooth transition function assumed to be contin- 
uous from [0, 1] onto [0, 1]. The parameters and //( 2 ) are the values of 
the mean in the two extreme regimes, that is when F — > and F — Y 1. The 
slope parameter 7 indicates how rapidly the transition between two extreme 
regimes is. The parameter c is the location parameter. 

Two choices for the function F are frequently evoked, the logistic function 
given by 

F L (x,r 1 , 7 ) = [l + exp(- 7 (x-r 1 )]- 1 (11) 
and the exponential one 

F e (x, n, 7) = 1 - exp(- 7 (x - ti) 2 ). (12) 

For example, for the logistic function with 7 > 0, the extreme regimes are 
obtained as follows 
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• if x — >• and 7 large we have F — >■ and thus /x t = //m, 

• if x — > 1 and 7 large we have F — > 1 and thus /x t = /i( 2 ). 
Theorem 3. Assume that (yt) satisfies (CP wift standard Gaussian white 

noise errors (e t ) and a bounded deterministic sequence (a t ) satisfying (G|). // 
under Hi the mean fi t follows the dynamic IfTty) then 

B n P ) + 00. (13) 

The proof of Theorem 3 is given in the Appendix. 

4 Finite sample performance 

All sequences are driven by a Gaussian white noise e t ~ N(0, 1). Simulations 
were performed using the software R jTT]. We carry out an experiment of 
1000 samples for nine series and we use four different sample sizes, n = 30, 
n = 100, n = 500 and n = 1000. 

In the model ([1]) we consider three dynamics for the mean fi t and the 
variance of : 

Dynamics of the mean: 

Ht = 1 for all t > 0, (14) 



1 /i (2) if [nn] + 1 < t < n ' v ; 



^ = ^(1) + (^(2) - n, 7), (16) 

we choose t\ = 0.5 (one break in the middle of the sample), //(i) = 1, /i(2) = 2, 
F is the logistic function given by ( TlT]) and 7 = 20. 
• Dynamics of the variance 

a t = 1 for all t > 0, (17) 



, if 1 < < < [nr 2 ] 
at 1 (7(2) if [nr 2 ] + 1 < t < 71 1 j 



o"t = cr ( i) + (a {2 ) - o-( 1 ))F(t/n,T 2 ,j), (19) 
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we choose r 2 = 2/3, crm = 0.5, ct( 2 ) = 1-5, F is the logistic function given 

by (dH) and 7 = 20. 

To study the size of the test we simulate the following three series: 

Series 1: fit is given by (|T4l) and a t is given by (fT7|) . no break in the mean 
and in the variance. 

Series 2: fit is given by (|T4l) and <7t is given by (TT8|) . no break in the mean 
and one abrupt break in the variance. 

Series 3: fi t is given by (TBI) and a t is given by (fT§j) . no break in the mean 
and one smooth break in the variance. 

To study the power of the test we simulate the following six series: 

• One abrupt change on the mean: 

Series 4- fit is given by ffl~5l) and a t is given by ffTTl) . one abrupt break in 
the mean and no break in the variance. 

Series 5: fi t is given by ffTBI) and a t is given by ffTSl) . one abrupt break in 
the mean and one abrupt break in the variance. 

Series 6: fi t is given by (TT5T) and <7 t is given by (|T9i) . one abrupt break in 
the mean and one smooth break in the variance. 

• A smooth change in the mean: 

Series 7: fi t is given by (TTBT) and a t is given by (ITTj) . one smooth break 
in the mean and no break in the variance. 

Series 8: fit is given by ffT6l) and cr t is given by ffT8|) . one smooth break 
in the mean and one abrupt break in the variance. 

Series 9: fi t is given by ffTBT) and cr 4 is given by f|T^]) . one smooth break 
in the mean and one smooth break in the variance. 



Table 1. Empirical test sizes (in %) 



n 

a 


n = 30 


n = 100 


n = 500 


n = 1000 


1% 

Series 1 5% 
10% 


0.2 
2.9 
5.1 


0.4 
3.3 
7.9 


0.7 
3.8 
8.2 


0.5 
4.1 
8.4 


1% 

Series 2 5% 
10% 


0.3 
3.4 
7.1 


0.9 
5.1 
10.6 


I. 3 
6.2 

II. 7 


1.3 
6.3 
12.4 


1% 

Series 3 5% 
10% 


0.5 
4.3 
7.9 


0.9 
4.9 
10.1 


1.1 
6.4 
12.7 


1.1 
6.3 
12.4 
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Note: Table 1 contains rejection frequencies of the null hypothesis of no change 
in the mean. Rejection frequencies are based on 1000 replications generated from 
the Series 1-3 where the nominal significance levels are 1% , 5% and 10%, the 
sample sizes are n = 30, n = 100, n = 500 and n = 1000. 

Table 1 indicates that the test is a somewhat conservative (the empirical 
size is lesser than the nominal one) when the time series is homoskedastic 
(Series 1) and overrejects the null (the empirical size is greater than the 
nominal one) if the time series is heteroskedastic (Series 2 and 3). 



Table 2. Empirical test powers (in %) 



n 

Ct 


n = 30 


n = 100 


n = 500 


n = 1000 


1% 

Series 4 5% 
10% 


18.3 
47.3 
61.9 


95.9 
98.8 
99.4 


100 
100 
100 


100 
100 
100 


1% 

Series 5 5% 
10% 


10.6 
33.9 
48.5 


85.0 
95.4 
97.7 


100 
100 
100 


100 
100 
100 


1% 

Series 6 5% 
10% 


14.2 
34.5 
48.7 


84.8 
94.8 
98.0 


100 
100 
100 


100 
100 
100 


1% 

Series 7 5% 
10% 


17.1 
46.6 
58.4 


92.9 
98.4 
99.3 


100 
100 
100 


100 
100 
100 


1% 

Series 8 5% 
10% 


12.6 
36.0 
52.1 


79.8 
93.1 
96.5 


100 
100 
100 


100 
100 
100 


1% 

Series 9 5% 
10% 


14.0 
35.9 
50.8 


74.8 
92.0 
95.5 


100 
100 
100 


100 
100 
100 



Note: Table 2 contains rejection frequencies of the null hypothesis of no change 
in the mean. Rejection frequencies are based on 1000 replications generated from 
the Series 4-9 where the nominal significance levels are 1% , 5% and 10%, the 
sample sizes are n = 30, n = 100, n = 500 and n = 1000. 

From Table 2, we observe that, except for the small sample size n=30, 
the test has a good power either for homoskedastic time series (Series 4 and 
7) or heteroskedastic time series (Series 5,6,8 and 9). Rejection frequencies 
of the null in abrupt change (Series 4, 5 and 6) are a somewhat greater than 
the ones corresponding to a smooth change (Series 7,8 and 9). 
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5 Application to the Stock index data 



We consider the daily returns of S&P 500 index, r t = log Pt — logP t _i, 
where P t is the daily closing level of the index between January 3, 1950 
and November 17, 2008. We test changes in the mean of the returns r t and 
the absolute returns y t = \r t \ . 

For the time series (y t ), 1 < t < n, the test statistic is given by 

k 

i=l 

where a 2 = YLt=i(Vt ~ V) 2 l n > A* = Ylt=i Vt/ n an d the corresponding p-value 
given by p — value = 1 — Fb^Bu). The cumulative distribution function of 
-Boo is given by (see Billingsley (1968)) 

oo 

F Boc (z) = 1 + 2 ]T(-l) fc exp{-2fcV}. 
k=l 

Although the distribution function Fb x involves an infinite sum, the series 
is extremely rapidly converging. Usually a few terms suffice for very high 
accuracy. For example, (see Massey (1952)) the 90%, 95%, and 99% quantiles 
are 1.225, 1.359 and 1.628 respectively. Note that the quantiles are reached 
with a high accuracy using only 2 terms i.e. 

2 

1 + 2 J^(-l) fc exp{-2A; 2 (1.225) 2 } = 0.9005625, 

k=l 
2 

1 + 2 ^(-l) fe exp{-2A; 2 (1.359) 2 } = 0.9502443 
k=i 

and 

2 

1 + 2 ^(-l) fe exp{-2A; 2 (1.628) 2 } = 0.9900245 
k=i 

Applying our test to r t yields p — value = 0.291 and hence the null 
hypothesis of no change in the mean is not rejected. 

To check if to the time series y t = \r t \is affected by breaks in the mean, 
we apply our test to y t to detect change in the mean. We obtain p— value = 
for y t , which strongly supports change in the mean of the absolute returns 
of S&P 500 index between January 4,1950 and November 17, 2008 



B n = max 

y/na l<k<n 
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Appendix. Proofs 

To prove Theorem 1 we will establish first a functional central limit theo- 
rem for heteroskedastic time series. Such theorem is independent of interest. 
Let D = D[0, 1] be the space of random functions that are right-continuous 
and have left limits, endowed with the Skorohod topology. The weak conver- 
gence of a sequence of random elements X n in D to a random element X in 
D will be denoted by X n =>- X. 

Consider a standard Gaussian white noise (et), i.e. E(e t ) = and 
var(£() = 1. Let (cr t ) satisfying and 

[tit] 

W n (T) = ^^J2a t e t , rG [0,1]. (20) 

Many Functional central limit theorems were established for covariance sta- 
tionary time series, see Boutahar (2008) and the references therein. Note 
that the process (<J t e t ) is not covariance stationary and hence Davydov's 
(1970) results can't be applied to obtain the weak convergence of W n in the 
Skorohod space. 

There are two sufficient conditions to have W n ==>■ W (see Billingsley 
(1968): 

i) the finite-dimensional distributions of W n converge to the finite-dimensional 
distributions of W, 

ii) W n is tight. 

Theorem Al. Assume that (e t ) is a standard Gaussian white noise and 
(a t ) satisfying fifty. Then 

W n =► W (21) 

where W is standard Brownian motion. 

Proof. To prove that the finite-dimensional distributions of W n converge 
to those of W it is sufficient to show that for all integer r > 1, for all 
< n < ... < r r < 1 and for all (a u a r )' G W, 

r r 

Z n = Y,ociW n {Ti) > Z= ^atWin). (22) 

i=i i=i 

Since Z n is Gaussian with zero mean, it is sufficient to prove that 

var (Z n ) var(Z) = ai ctj min(rj, Tj). (23) 

l<i,j<r 
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For all (rj, tj) 

cov(W n (Ti),W n (Tj)) = var(W / " ri (min(r i ,r J ) 

[nmin(Ti,Tj)] 

— > min(rj, Tj) as n — )■ oo, 

since var(Z n ) = Xa<i j<r a « a!jCOv(W n (Tj), Wn^)), the desired conclusion 
(|23|) holds. 

To prove the tightness of H^,, it suffices to show the following inequality 
[Billingsley (1968), Theorem 15.6] 

E (\W n (r) - W n {T X )\-> \W n (r 2 ) - W n (r)\^ < (F(r 2 ) - F(n)) a (24) 

for some 7 > 0, a > 1, and F is a nondecreasing continuous function on 
[0,1], where < Ti < r < t 2 < 1. 
We have 

/ H \ / [nr 2 ] 

^(l^r)-^^)! 2 !^^)-^^)! 2 ) = ^ E °? E 

< C( r - ri )( ra - r ) 

for some constant C > 
<C (r 2 -n)72. 

Consequently ([21]) holds with 7 = a = 2 and F(t) = t. 

Al. Proof of Theorem 1 

We have 

H 

B »W = ^E(W"/i) 
/_ \ -. [™ t ] 

By using ( 121]) it follows that 

(I) B » - B 

11 









sup 




TG[0,1] 



and hence by continuous mapping theorem 

»| . sup \B(r)\. 

re[0,l] 

To achieve the proof of (J7|) it's sufficient to prove that 

o P ^ 2- (25) 

Let JF t = a — field (ei,...,e t ) and F = (J c n ) the corresponding filtration. 
Then N n = Y^t=\ a t £ t * s a square integrable martingale adapted to F, with 
increasing process (N n ) = Y^=i °t- 
By using flS]), (N n ) satisfies 

(Nn) -2 

therefore (see Duflo (1997), theorem 1.3.15. ) 

1 " 

-^a t Et a.s. 0, (26) 
n z — ' + 

t=l 

where a.s. denotes the almost sure convergence. 

Likewise M n = Y^t=\ a t( £ t — 1) is a square integrable martingale adapted 
to F, with increasing process (M n ) = 2^™ =1 of, hence theorem 1.3.15. in 
Duflo (1997) implies that 

1 n 

— — ^ a t( £ t - i)—^ almost surely on {(M^) = oo} (27) 

\ M n) t=l 

where = lim^oo (M n ) . Since 

' n \ 2 n 

5>n 



t=\ / t=i 



The assumption ([6]) implies that there exist an universal constants < K\ < 
K 2 < oo such that 



1 

n is 



n 
t=l 



this together with (1281) implies that (M n ) > 2nKf which implies that 

{(M oc ) = oo} = fi 
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and hence 



1 n 



(29) 



Since (at) is a bounded deterministic sequence, then there exists an universal 
K > such that af < K for all £ > 1, hence (M n ) < nK for all n, therefore 



|E«?«-d 

t=i 



(M n ) 



< K 



using (|29i) . it follows that 



1 n 

t=i 



By using (JSSJ-®, 



cr t e t 



a.s. ^ /i 



(30) 



(31) 



and 



n 14 — ' n ' — ' n ' — ' n 

t=i t=i t=i t=i 

a.s. ^ ji 2 + a\ 



Combining (l3Tj) and (|32j) we obtain 



a 2 



n — ' \ n 

t=i \ t=i 

a.s. v a 2 , 



and hence (1251) follows. 



A2. Proof of Theorem 2 

For all t < n we have 
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S n (r) = B»(r) + Si(r) (33) 

where 

1 f [nrl 
5 n( r ) = ~y=^ { (kiW) + ( n - Ki] + 1 )i"(2)) 

Straightforward computation leads to 



a 2 a.s. , al 



a\ +-71(1-71)0(1) -M(2)) 5 



Therefore 



and 



Hence 



S°(t) ,-5(r) (35) 



Bl{r) r(l -ri)(/A ( i) -// (2 )) 



^n( r ) Q - g - ) sgn(fi {1) - //( 2 ))oo (36) 

where sgn(x) = 1 if x > and —1 otherwise. Finally (I3"3"|) . ( I3"5"j) and ( l36p 
imply that 

|BnM| P ) +00 

and then the desired conclusion (JSJ holds. 
A3. Proof of Theorem 3 

B n (r) = B° n (r) + Bl(r) (37) 
where B®(t) is given by (1341 and 



v n(T I ^ " 



t=l 



(w-to) (g F(t/ „ iTii7) _M£ F(i/n , Tl , 7) 



Straightforward computation leads to 



n 
t=i 



14 



a a.s. . a 



2 ^2 



°"2 + (/ i (2)-A t (l))' 



J F 2 (x,r 1 ,y)dx - (J F(x,Ti,~/)dx\ 



Therefore for all r G (0, 1) 



fli(r) ^m-m) T{T) 



where 



T(t~) = / F(x,Ti,'y)dx — t / F{x,T\,^)dx. (38) 
Jo Jo 

Moreover, there exists r* G (0, 1) such that T(r*) 7^ 0, since if we assume 

that T(r) = for all r G (0, 1) then 

= F(t,t 1)7 )- y F(x,r 1)7 )^ 
= 

for all r G (0, 1) which implies that F(r, n, 7) = Jq F(x } Ti,y)dx = C for all 
re (0,1) or 



fH = ^(1) + (^(2) - A*(i))C 
= /i for all t > 1 

and this contradicts the alternative hypothesis Hi. 



and T(r*) 7^ imply that 

\B n (r*)\ P ) +00, 
consequently, the desired conclusion (TIB"]) holds. 

Remark 2. For the logistic transition, the function T(r) in fl38l) is given 



by 



T(r) = i{rlog[(l + exp( 7 (r 1 -l)))(l + exp(7ri))]} 

- - {log [(1 + exp(7(ri - r)))l + exp(7n))]} , 

7 

15 



and for the exponential transition 

T ^ = V^ {(T " ^^v^i) + er/(V7(ri - r)) - rerf^n - r))} , 
where erf is the Error function given by 

2 r 

erf{x) = —j= I exp(— t )dt. 
V 71 Jo 
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